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On the trajectories and performance of Infotaxis, 
an information-based greedy search algorithm 
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Abstract. - We present a continuous-space version of Infotaxis, a search algorithm where a 
searcher greedily moves to maximize the gain in information about the position of the target 
to be found. Using a combination of analytical and numerical tools we study the nature of the 
trajectories in two and three dimensions. The probability that the search is successful and the 
running time of the search are estimated. A possible extension to non-greedy search is suggested. 
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Introduction. — Reaching a target with limited in- 
formation is a fundamental task for living organisms. 
Small organisms, such as bacteria and eukaryotic cells, 
are thought to estimate and ascend the gradient of nutri- 
ent concentration, a process called chemotaxis (l||6j. At 
the scale of a larger organism the Reynolds number is 
higher [I]: most biologically relevant chemical fields be- 
come turbulent and dilute. As a result, the trajectories 
of insects following odor traces appear much more com- 
plex than those of smaller organisms 12 . The modeling 



of search processes in presence of noisy information is im- 
portant not only for biology, but also for robotics [8|[9l. 



Assume the search has proceeded for some time, and 
the searcher has received some hits, i.e. has detected some 
molecule of odor sent by the target, along the trajectory. 
How should the searcher move next? The timing and loca- 
tions of the hits, as well as the absence of hits along the re- 
maining parts of the trajectory all provide useful informa- 
tion about the location y of the target. In Bayesian terms, 
this defines a posterior probability Pt(y) for the position 
of the target. Going towards the maximum of P t is not 
an optimal strategy as the maximum does generally not 
coincide with the target, especially in the initial stage of 
the search process. Recently, Vergassola, Villcrmaux and 
Shraiman proposed an alternative strategy, called Info- 
The searcher moves to maximize the (expected) 
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taxis 

gain in information about the location of the target, that 
is, the loss in the entropy of the distribution Pt{y). As 



the search goes on, the entropy typically decreases, un- 
til the source is finally located. The strategy naturally 
balances the needs for exploration (harvesting more infor- 
mation about the target location) and exploitation (going 
towards the maximum of P t ). Infotaxis was implemented 
and tested on two-dimensional square lattice^] the target 
was almost always found, and the distribution of search 
time appeared to decay exponentially. 

Yet some important questions about Infotaxis remain 
open. First, how well does the algorithm perform in 
three dimensions? In addition to its practical interest, 
this question arises naturally in the context of Brown- 
ian motion theory. Purely random walks are space-filling 
in two dimensions, and transient in higher-dimensional 
spaces. Finding a target in three dimensions is there- 
fore much harder, and constitutes a real test for the ca- 
pabilities of Infotaxis. Secondly, how dependent of the 
underlying lattice are the results reported in 11 ? Real- 



istic descriptions of animal behavior or implementations 
in biomimetic robots require us to consider continuous 
spaces. In addition the presence of a lattice introduces 
anisotropies, while the odor propagation model used in 



11 was isotropic. Thirdly, two-dimensional trajectories 
seem to exhibit spiral-like shapes. How precisely can we 
characterize those spirals, and what arc their counterparts 
in three dimensions? 



1 Few short trajectories were obtained on small three-dimensional 
lattices in [10] . 
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In this letter, we derive the equation of motion for the 
Infotaxis searcher in the continuous space. We then in- 
troduce an algorithm to solve this equation^] The perfor- 
mances of Infotaxis, i.e. the probability of success and the 
distribution of the search times are studied in D = 2 and 
3 dimensions. The spiral- and coil-like shape of the search 
trajectories for, respectively, D = 2 and 3, and the pinning 
of the trajectory around the received hits are investigated 
analytically and numerically. We show that the motion of 
a searcher receiving an average and deterministic signal is 
a good predictor of the typical properties of the motion in 
the presence of stochastic hits. Finally we discuss a possi- 
ble extension to a non-greedy search strategy, which could 
help reduce pinning effects. 

Equation of motion for the searcher. A point- 
source in y* emits particles, which diffuse in space, and 
have a finite lifetime. In the stationary regime, the prob- 
ability per unit of time to encounter a particle in x is 
denoted by R(y* — x) [IT] [Supplementary information]. 
Function R has an integrable divergence at the origin 
(R(u) ~ — log it in D — 2, ~ i in D — 3 dimensions, 
when u — ¥ 0) , and exponentially decreasing tails for large 
distances u. In the following distances are measured in 
the unit of the decay length of R. The unit of time is the 
inverse of the rate of emission of particles by the source, di- 
vided by the (dimensionless) linear size, a, of the searcher 
for D = 3, or multiplied by log(l/a) for D = 2 [II] . 

Let x(t) be the position of the searcher at time t. We de- 
note by Nh the number of particles detected (called hits) 
at earlier times, < ti < t, with i = 1, . . . , Nh . Based on 
those hits, the searcher can draw a probabilistic map over 
the possible locations y of the source. In the Bayesian 
framework, the posterior probability density Pt (y) for the 
location of the source is the (normalized) product of the 
probabilities of having detected the Nh particles at loca- 
tions x(tj), times the probability of not having detected 
any particle at other locations along the trajectory, times 
the prior probability density Po over y, 

Nh 

P t (y) a IJ-R(y "*(**)) e -/o^(y-x(0) Po(y) . (1) 

i=l 

Hence, P t diverges where the hits have been received and 
vanishes in the other places along the trajectory. In the 
following we will use brackets to denote averages over this 
posterior distribution, 

</(y))y;t = J dy P t (y) /(y) . (2) 

Assume now that the searcher stays in x(t) during an in- 
finitesimal time St. The number of hits, n, received dur- 
ing this time interval is a stochastic variable equal to zero 
or one, with probabilities p(0|y) = 1 — 5t R(y — x) and 
p(l|y) = St R(y — x), depending on the location y of the 

2 The code is publicly available from http://www.lps.ens. fr/ 
~barbi eri| 



source. In the language of information theory, the particle 
emission and detection system can be thought as a noisy 
channel, and n is the output message associated to the 
input codeword y. The mutual information SI between n 
and y is 

(3) 

up to 0(St 2 ), where 

is the entropy rate of the posterior distribution P t . Info- 
taxis stipulates that SI should be maximized, or, equiva- 
lcntly that V t should be minimized, i.e. made as negative 
as possible. In other words, interpreting Vt as a potential, 
the searcher should descend the gradient of V t . A natural 
equation of motion is then 

7 (t)i(t) = -V x V t (x(f)) , (5) 

where 7(t) plays the role of a friction coefficient. A possi- 
ble choice is j(t) — |V x V t (x(t)) \/vq, to keep the modulus 
of the velocity fixed and equal to Vq. This is close to 
the lattice version of [II], where the searcher could either 
stay immobile or move by one lattice site, and the velocity 
could take only one non-zero value. In general, j(t) can be 
any positive function of the time. In the following, we will 
first consider the case j(t) = 7 constant. We will later dis- 
cuss to what extent the trajectories and the performances 
change when 7 varies with the time. 

Numerical integration. — The equation of motion 
([5]) is highly non-linear and depends on the whole history 
of the search process through the posterior probability ([TJ . 
To solve equation ^ numerically we discretize the time 
with a step At. The positions x^ of the searcher at the 
instants tg — £ At, where £ is a positive integer, are mem- 
orized, as well as the occurrences (times) of the hits. The 
amplitude of the t elementary move is estimated from 
|5j): x e+1 - Xt = -^7) V x V t (x£). The calculation of 
the gradient of the potential requires to estimate averages 
over the space y with measure P t To do so, we use 
the importance sampling Monte Carlo method [7j. The 
term inside the bracket in Q, and its gradient with re- 
spect to x are exponentially decreasing functions of the 
radial distance u — |x^ — y|. We thus perform the change 
of variable u = Uq(1 — v)/v, where v G]0; 1], and u is a 
scale parameter. We draw Nmc values of the new vari- 
able, v a , a = 1, . • • , Nmc, uniformly and at random, and 
calculate the corresponding u a - Angular variables Jl a are 
uniformly sampled on the unit sphere or circle to obtain 
the points y a = x^ +u a O a in the original space. The cor- 
responding probabilities Pt(y a ) are computed using Simp- 
son's method to calculate the integral over time in |TJ). 

The algorithm of [TTJ stored and updated P t , which 
made the computational time linear in t and in the size 



p-2 



Search trajectories and performances of Infotaxis 




20 40 60 80 100 



I 1 1 1 — — '—M- 



D 



_^ -J 0.25 

0.001 0.01 0.1 



Fig. 1: Two-dimensional trajectories for 7 = .01 (A) and 
7 = .1 (D), after one hit is received at time t = (Po = R)- 
B. squared distance to the origin, d(t) 2 , vs. time t for four 
values of 7. C. spacing b between turnings vs. 7. The dotted 
line has slope ~. Integration is done with Nmc = 10 4 points. 



of the lattice. Our procedure recalculates P t at each time 
step, which makes the computational time quadratic in t, 
and independent of the a priori infinite size of the space. 
Errors on P t do not accumulate with time, and the accu- 
racy is directly controlled by the number of Monte Carlo 
sampling points, Nmc- In addition, the map P t is guaran- 
teed to be accurately determined where it really matters, 
i. e. in the vicinity of searcher. 

Initial stage of the search. — We first focus on the 
initial stage of the search process, which strongly depends 
on the a priori distribution, Po- A possible choice is the 
one-hit prior, Po = R, which means that the search starts 
only when a first hit is received at time t — 11 . In 



two dimensions and before subsequent hits are detected, 
the search trajectories are Archimedean spirals [5p0 for a 
large range of values of 7 (Fig. [l]^). The squared distance 
of the searcher to the origin at time t, d(t) 2 , increases 
linearly with t, and is, to a large extent, independent of 
7 (Fig. [TJ3) . The spacing b between successive turnings is 
independent of time and increases as y/j (Fig. [lp); the 
velocity |x| ~ J decreases with the friction 7 as expected. 

The increase of b can be intuitively understood: the 
larger 7, the longer the searcher spends along the tra- 
jectory without receiving hits, and the more likely is the 
source to be located far away. For values of 7(> .08) 
such that b would exceed the length (= 1) over which R 
decreases, the spiral nature of trajectories breaks down 
(Fig. |TjD) . We have run simulations with a modified po- 
tential Vt, where the arguments y — x and y' — x of the 
functions R in Q were divided by a large factor (= 10). 
The regular spirals then disappeared, and looked like the 
trajectory in Fig. [Tp, even for small values of 7. 

Simulations with other prior distributions show that the 



long distance behavior of Po is critical to the existence of 
spiral trajectories, while the behavior of Po close to the 
origin is irrelevant. Choosing Po(y) ~ cxp(— |y|/yo) we 
obtain spirals as long as yo is not too large. The reason 
is that the spacing b is proportional to y : spirals explore 
as much space as allowed by the prior. Spirals breakdown 
for the (7-dependent) value of yo such that b exceeds 1. 

Search trajectories in three dimensions display a more 
complex structure than their two-dimensional counter- 
parts. Figure [2] shows the motion of the searcher with 
the one-hit prior, Po = R. Roughly speaking, the trajec- 
tory is constituted of subsequent shells of increasing radii, 
which are densely covered before a new shell is built. The 
distance to the origin, d(t), is compatible with t 1 / 3 at large 
times, but grows faster at smaller times (Fig.|2|. To better 
understand how trajectories develop in three dimensions, 
we have resorted to a small-x expansion of the potential 
Vt . The relevant contributions to the equation of motion 
are, up to cubic order, 



7 x(t) = ai(t) x(t) + a 2 (t) / dt' x(t') + 



dt' x(i') 



(6) 



ftWIxCOf +ft(f)x(0- /dt"x(t") 





where the coefficients a,(i) have explicit analytical ex- 
pressions. When x is very small, only the linear terms 
matter. As ct\ ~ "37 "^f^ > f° r large t, the trajectory 
tends to follow a line radiating from the origin. However, 
the straight line is unstable against local bending since 



a 2 



. 3\/3 log* 



< 0. The trajectory thus acquires a spi- 



ral shape confined within the plane spanned by x(0) and 
x(0). The presence of cubic terms (/3i,/?2 > 0), which are 
not constrained to lie in this plane, eventually lead to a 
cross-over from the quasi-bidimensional spiral to a fully 
three-dimensional trajectory (Fig. [2]). 

Replacing coefficients ai,«2 with the smaller values 
ol\ — ^,0,2 = — fr, with ai,a 2 > 0, allows for an ex- 
act resolution of ([6]). A spiral is found when a\ < 02, 
with a radius and an angle growing as, respectively, t^ 
and rjlogt, where lu — ai 2 ~ 7 and r/ = \J 4a27 — (7 + ai) 2 . 
As 7 increases so does the angular velocity (oc rj), while 
the growth exponent uj diminishes: spirals stop growing if 
7 is too large, a fact reminiscent of Fig[lJ). Numerical res- 
olution of ^ shows that this scenario is qualitatively un- 
changed when the logarithmic factors in ai^a 2 ar e taken 
into account. 

Pinning after a hit. — Examples of trajectories 
where the searcher receives hits at times U > are shown 
in Fig. [3j Generally speaking, the trajectories are denser 
when more hits are received. After each hit i, the poste- 
rior distribution P t is considerably reinforced in x(tj) and 
its neighborhood. The searcher remains in the immediate 
vicinity for a certain time, t w , until the search resumes. In- 
formally speaking, the searcher makes sure that the source 
is not in x(tj) before looking elsewhere. Imagine that the 
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Fig. 2: A three-dimensional trajectory in the absence of hit for 
7 = .01 (left), with its quasi two-dimensional initial portion 
(top); the time axis is color coded. Bottom: distance to the 
origin, d(t), compared to the power laws t' 75 , then i 1 / 3 . 



searcher has not moved at all for a period of time t w after 
the hit at time £j. The posterior distribution is then 

P ti+tw (y) ex P t - (y) R(y - xfe)) e" 4 " «(y-*C* 4 )) . ( 7 ) 

Assuming the posterior distribution right before the hit, 
P t - , is smooth in the vicinity of x(£j), the potential 
Vt i +t ra (x(^i) + u) is a function of the small displacement 
u = |u| and t w only. There are a local maximum in u = 0, 
since ai > in and a global minimum in u m (t w ) > 0. 
For t w < .4, u m < .01 is smaller than the error on the 
position deriving from our Monte Carlo integration, while 
for t w > .5, u rn > .1, and the displacement of the searcher 
is easily seen. 

The pinning effect is an important feature of the contin- 
uous formulation of Infotaxis, and was not observed on a 
lattice. The reason is that, at each time-step, a whole lat- 
tice site probability was set to zero in 11 , which created 



a strong repulsive effect for the searcher and prevented 
pinning. In the continuous space, however, the trajectory 
has zero measure and the repulsion is too weak to over- 
ride the pinning. As the searcher gets closer to the source, 
the average delay r between successive hits gets smaller. 
When t — t w , the searcher could, in principle, come to 
a complete halt. The distance from the source for which 
this happens, dhait, depends on the dimension: dhait = -1 
for D = 2, d ha it = .3 for D = 3. 

Performances. — We now introduce a source and 
observe the trajectory of the searcher reacting to hits 
(Fig. [3]). We are interested in the probability that the 
search process is successful as a function of the initial dis- 
tance to the source, do- If the searcher reaches the neigh- 
borhood of the source of radius dhait defined above the 
source is declared found. If the searcher misses this neigh- 
borhood and reaches a distance df a n 3> 1 to the source 
such that new hits are highly unlikely, the searcher is de- 
clared to be lost. Examples of successful and unsuccessful 
trajectories are shown in Fig. [3j 

Figure [4] (left) shows that the probability of success in 




Fig. 3: Examples of search trajectories with hits in D = 2 
(top, 7 = .02) and D = 3 (bottom, 7 = .01) dimensions. 
Trajectories on the left find the source, while searches on the 
right are not successful. The initial distance to the source is 
do = 2. Red disks or spheres represent points at distance 
< dha.lt to the source. Black squares or cubes locate the hits; 
their size correspond to the amplitude of the erratic motion of 
the searcher during the pinning after a hit. 



dimension D — 2 is compatible with unity for all distances 
do smaller than a few units, in agreement with the find- 
ings of JTl] . On the contrary, in dimension D = 3, the 
probability of success is definitely smaller than one, and 
is about .8 for distances do ranging from 1 to 3 and for 
7 = .01. We have also measured the probability of success 
at fixed do over a range of values of 7 and found little 
variation (Fig. |4j right). 

Figure [5]A_ shows that the distribution of the search 
times t s of successful runs has a positive skew and a 
roughly exponential tail not only in dimension D = 2 11 
but also in dimension D = 3. The exponential nature of 



the tail was checked for various values of the distance do. 
Figure [5}3 shows that the average time to find the source, 
t s , decreases with 7. The CPU time scales as A (t s / At) 2 , 
where At = 7 is chosen to obtain numerical stability, i.e. 
small enough local moves at any step I. Hence, the CPU 
time is much larger for small friction (Fig. [5p). We find 
A ~ 3 ms on one core of a 2.4 GHz Intel Core 2 Quad desk- 
top computer, and for Nmc = 10 4 Monte Carlo steps. The 
CPU time can be decreased by choosing a smaller value 
for Nmc, or by increasing 7 (and At) with time. 

Case of a time-dependent friction j(t). — The 
results reported so far correspond to constant frictions 
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Fig. 4: Probability of success of Infotaxis as a function of the 
initial distance to the source, do (left), and of the friction 7 
(right). Top points correspond to D — 2 dimensions, bottom 
points to D = 3. The numbers of runs is of about 200 for each 
point. All probabilities where obtained with df a n = 8. 




Fig. 5: A. histograms of the search times t s in D = 2 (7 = .02) 
and D = 3 (7 = .01) dimensions for an initial distance do — 
2 to the source. Full histograms correspond to the average 
trajectories, contour histograms to trajectories with random 
hits. B. Average search time t s as a function of 7. C. total 
CPU time as a function of 7, calculated as (t s /At) 2 . 



7. We have generated trajectories with various time- 
dependent functions j(t), e.g. slowly increasing to reduce 
the scaling of the CPU time with t (Fig. [6)4.) , or with the 
fixed- velocity requirement (Fig. [6j3). From a qualitative 
point of view, we observe no drastic difference with the 
constant 7 case, provided that 7(f) does not exceed the 
maximal value (~ .08) at which 6 ~ 1 and spirals break 
down. For instance, the distance between turns in the spi- 
ral region of the trajectory in Fig.JBJ'V can be deduced from 
the value of b(-/(t)) in Fig.jlp. In the fixed-velocity case of 
Fig. [6j3, before the first hit is detected, 7(i) shows regular 
oscillations and the trajectory has a spiral-like shape with 
b corresponding to the maximum value of 7(f)(~ .011). 
Larger fluctuations are visible during the erratic motion 
after each hit, but 7(f) remains smaller than the arrest 
value 7 ~ .08. 

We have seen in Fig. [3] that the probability of success is 
essentially independent of d and 7. This key result can be 
understood as follows. Far away from the source, hits are 
very unlikely and the trajectory develops as a spiral. As 
the area spanned by the trajectory is roughly independent 
of 7 (Fig. [Tf3), the time it takes for the searcher to reach 
the D— dimensional sphere of radius 1 and centered in the 
source will be roughly independent of 7 and will strongly 
increase with do, while the time spent in the sphere and 
the number of hits received will be essentially independent 
of both 7 and do. We conclude that varying 7 has little 
consequence on the performance of Infotaxis, as long as 
the spiral-like motion is possible. 

Motion in presence of the 'average' signal. 

Certain characteristics of the search time distribution, 
such as the typical (most probable) value of t s , can be 
assessed from the study of an abstract searcher receiving 
an average signal rather than discrete and sparse hits. To 
define an average posterior density P t a " (y) we remark that 
Pt (y) contains the product of Njj stochastic R factors over 
the hits in Q. It is natural to define P? v {y) through the 



average value of logP t (y) over the hits: 

P av (y) oc e~fo dt'«(y-x(O)+fl(y*-x(O)iogi?.(y-x(O)p ( y ) 

(8) 

up to a multiplicative normalization constant; here, y* 
denotes the location of the source as usual. We define the 
average search trajectory as the solution of equation (|5j ) 
with the average (•) ^ calculated over the measure 
Average search trajectories are obviously smoother than 
trajectories with random hits, but have common features, 
such as a possible return towards the origin after having 
been close to the source. 

Figure [5p\. shows that the search time for the average 
motion is in very good agreement with the typical search 
time for trajectories with random hits. This coincidence 
has been observed for all the frictions 7 and distance do 
to the source we have tested. Note that, while the average 
motion is fully deterministic, some noise is introduced to 
break the rotational invariance and select the initial phase 
of the spiral; this noise is responsible for the small width 
of the full histograms shown in Fig. 

Figure [7] shows the average search trajectory and a ran- 
dom trajectory in D = 2 dimensions, together with the 
entropies of their posterior distributions. In the random 
case, the entropy abruptly decreases right after a hit, then 
increases until the next hit is received (due to the expo- 
nential time decay in P t ([!])). As for the average motion, 
the entropy shows weak oscillations (due to the spiral mo- 
tion) superimposed to a smooth trend, which decreases as 
the searcher gets close to the source. 

Conclusion. — In this letter we have presented a 
continuous-space version of Infotaxis, and have analyzed 
its behavior in two and three dimensions. When the ini- 
tial distance to the source, do, is of the order of the decay 
length of R, the probability that Infotaxis finds the tar- 
get is essentially equal to unity in D = 2, and is smaller 
(~ .8) in D = 3 dimensions. The probability of success is 
roughly independent of j(t) in ([5]), while the search time 
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Fig. 6: A. A search trajectory for the time-dependent 7(i) 
shown below. B. A trajectory with fixed velocity vo = 2, and 
7 (i) — |V x Vt|/«o. The source is located in (\/2, V2) (circle). 



and the CPU time strongly depend on the friction. The 
quadratic increase of the CPU time and the presence of 
the pinning effect make the computational cost increase as 
the searcher gets closer to the source. Note that the CPU 
time could be made linear in t s (instead of quadratic) if 
the integral in ([I]) were restricted to the recent past, i.e. 
if the search had a finite memory. 

The pinning of the trajectory by the hits is a direct con- 
sequence of the greedy nature of Infotaxis: the searcher 
moves to maximize the immediate gain in information, 
irrespectively of what could be gained on a longer time 
horizon. To overstep this greedy strategy consider the ex- 
pected gain in information, I[x(t');t < t' < t + t], when 
the searcher plans to move along a portion of trajectory 
x(i') during the current time t and the time t + r. The 
best portion of trajectory is determined through the max- 
imization of /, minus a quadratic term oc 7X 2 penalizing 
large velocities. While this variational calculation appears 
intractable for general r, a systematic expansion in powers 
of r is possible. To the lowest orders in r the equation of 
motion becomes 

r 2 (V x V x U t (x))x + 7 x = -V x U t (x) (9) 

up to 0(t) corrections to the friction 7 and to the force 
on the right hand side. The introduction of a finite-time 
horizon, r, gives birth to an inertial term, with an effective 
mass tensor proportional to the curvature matrix of the 
potential Q. This inertial motion could help reduce the 
pinning following a hit, and avoid the slowing down of the 
searcher close to the source. The analysis of ^ and of the 
search trajectories is left for a future work. 

Last of all, the shapes of the trajectories observed in two 
and three dimensions result from a trade-off between the 
self-repulsion of the trajectory (the searcher does not come 
again close a point where the source was not detected) 
and the confinement due to the hits or to the prior (the 
source is likely to be close to a detection). This trade- 
off is present in physical systems such as polyelectrolytes 
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Fig. 7: Entropy S(t) (bottom, left scale) for one trajectory x(£) 
obtained with random hits (top left, full curve, 3 hits are re- 
ceived) and the average trajectory (top right, dashed curve). 
The dotted line shows the average number of hits Nh (right 
scale) received along the average trajectory. The source is lo- 
cated in (s/2, v2) (circle). 



(charged polymers) confined in a volume or on a surface 
J3J. It is however unclear how far the analogy between 
the out-of-equilibrium process generated by Infotaxis and 
equilibrium polyelectrolytes could be pursued [2]. 
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